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Background. Diarrhea is a leading cause of illness and death among children aged <5 years in developing coun- 
tries. This paper describes the clinical and epidemiological methods used to conduct the Global Enteric Multicenter 
Study (GEMS), a 3-year, prospective, age-stratified, case/control study to estimate the population-based burden, micro- 
biologic etiology, and adverse clinical consequences of acute moderate-to-severe diarrhea (MSD) among a censused 
population of children aged 0-59 months seeking care at health centers in sub-Saharan Africa and South Asia. 

Methods. GEMS was conducted at 7 field sites, each serving a population whose demography and healthcare 
utilization practices for childhood diarrhea were documented. We aimed to enroll 220 MSD cases per year from 
selected health centers serving each site in each of 3 age strata (0-11, 12-23, and 24-59 months), along with 1-3 
matched community controls. Cases and controls supplied clinical, epidemiologic, and anthropometric data at enroll- 
ment and again approximately 60 days later, and provided enrollment stool specimens for identification and character- 
ization of potential diarrheal pathogens. Verbal autopsy was performed if a child died. Analytic strategies will calculate 
the fraction of MSD attributable to each pathogen and the incidence, financial costs, nutritional consequences, and 
case fatality overall and by pathogen. 

Conclusions. When completed, GEMS will provide estimates of the incidence, etiology, and outcomes of MSD 
among infants and young children in sub-Saharan Africa and South Asia. This information can guide development 
and implementation of public health interventions to diminish morbidity and mortality from diarrheal diseases. 
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There has been substantial progress toward meeting Millenni- 
um Development Goals for child survival during the past 2 
decades, such that under-5 mortality rates have decreased in 
every developing region of the world. Nonetheless, the rates 
have fallen more sharply in wealthier areas [1], resulting in a 
large and growing share of deaths in the poorer developing 
regions. As further declines are made possible by expanding 
interventions that target the principal causes of death and 
focus on the most vulnerable children, the availability of accu- 
rate, up-to-date assessments at country levels becomes even 
more important to guide strategic planning and resource allo- 
cation. This is especially true for sub-Saharan Africa and 
South Asia, where 50% and 32%, respectively, of the estimated 
annual 7.6 million under-5 deaths are now concentrated and 
where current, systematically collected information on the 
burden and major causes of child death is lacking [2]. 

Diarrheal diseases continue to be major causes of childhood 
mortality in developing countries. The proportion of deaths 
attributed to diarrhea among children 1-59 months of age is 
estimated to be 25% in Africa and 31% in South Asia [3]. 
These estimates were calculated by abstracting studies pub- 
lished between 1980 and 2009 that utilized verbal autopsies 
( postmortem interviews of family members) to assign cause of 
death in representative populations. Statistical models were 
applied to derive estimates of diarrhea-specific mortality and 
to extrapolate across countries and regions. Modeled estimates 
of disease burden are an invaluable metric for assessing pro- 
gress toward achieving health objectives and for estimating the 
impact of various interventions; however, this approach faces 
limitations imposed by the quality, scope, age, and consistency 
of the underlying data. Analyses of the causes of childhood 
death based on verbal autopsies are subject to misclassification 
[4, 5], and if they include studies performed over several 
decades, the results may not reflect the current situation. 
Without concomitant morbidity assessments, one cannot deter- 
mine to what extent secular trends in declining disease-specific 
mortality represent lower disease incidence or diminished case 
fatality (which can have different determinants and respond to 
different interventions). Rigorously conducted, prospective, 
population-based studies can be used to strengthen modeled 
disease burden estimates [6-8]. Moreover, such studies are es- 
sential for providing the detailed information needed to 
design new and improved interventions to prevent and treat 
the most life-threatening and disabling episodes, which, in the 
case of diarrhea, would include knowledge about the etiology, 
risk factors, nutritional sequelae, and case fatality. 

We conducted the Global Enteric Multicenter Study 
(GEMS), a 3-year, prospective, age-stratified, matched case/ 
control study of moderate-to-severe diarrhea (MSD) among 
children 0-59 months of age belonging to a censused popula- 
tion and seeking care at hospitals and health centers at 7 sites 



located in sub-Saharan Africa and South Asia. A common re- 
search protocol with standardized epidemiologic and microbi- 
ologic methods was used to facilitate intersite comparisons 
and allow aggregate estimates of etiology and incidence. This 
paper describes the study design, including site selection, a 
surveillance system to characterize the demography and 
healthcare utilization practices of the catchment population, 
methods for enrollment, data collection and follow-up of case 
and control children, and quality control activities. We discuss 
challenges encountered in the implementation of a large study 
involving heterogeneous populations located in resource-poor 
settings. 

METHODS 

Objectives of the Study 

The primary objective of GEMS was to measure the popula- 
tion-based burden, microbiologic etiology, and adverse clinical 
consequences of MSD in developing countries, overall and by 
age, pathogen, site, and clinical syndrome (simple nonbloody 
diarrhea, dysentery, or profuse watery diarrhea). The adverse 
clinical consequences of interest included growth faltering ac- 
cording to World Health Organization (WHO) standards [9], 
persistent diarrhea lasting >14 days, and death. The secondary 
objectives were (1) to determine the antigenic and genotypic 
characteristics of the leading pathogens to guide vaccine devel- 
opment; (2) to elucidate the risk factors attributable to the 
host, the microorganism, and the environment that are associ- 
ated with the occurrence and adverse clinical outcomes of 
MSD; (3) to estimate the public and private financial costs, 
both direct and indirect, incurred during an episode of MSD; 
and (4) to create a central repository of well-characterized 
clinical specimens and isolated etiologic agents that can be 
shared with other investigators for future research. 

Site Selection Criteria 

Seven field sites were selected among countries in sub-Saharan 
Africa (Kenya, Mali, Mozambique, and The Gambia), and 
South Asia (Bangladesh, India, and Pakistan) with moderate 
to high under-five childhood mortality (Table 1). To create a 
broad view of enteric disease epidemiology, we chose sites that 
together exemplified a spectrum of child health indicators, 
with variations in the prevalence of malaria and human im- 
munodeficiency virus (HIV) infection, and a mixture of 
urban, rural, and periurban settings (Table 1). Sites were re- 
quired to have access to a population that had been or could 
undergo a census accompanied by an address system to allow 
households to be revisited in the future, and to 1 or more 
healthcare facilities that provide care to children from that 
population with diarrhea. Infrastructure with the potential for 
computerized data management, secure freezer storage, at 
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Table 1. Selected Child Health Indicators Available in 2005 and Used to Guide Site Selection 3 



National Statistics 











No. SHCs 
in CCS 


Population 
<5y c 


\J IM I pel 

Capita 
(US$) 


I IRMR b 
uoivi n 

(Country 

Rank) 


% HIV+ 
(1 5-49 y) d 


Malaria 
Rate 6 


% <5 y 
Wasted' 


% <5 y 
Stunted' 


% Using 
Improved or 
Adequate 9 


Receiving 
ORS h 


% 1 y 
DPT3' 


Country 


City 


Partner 


Setting 


Water Sanitation 


Mali 


Bamako 


Centre pour le 
Developpement 
des Vaccins du 
Mali (CVD-Mali) 


Urban 


9 


31 768 


290 


220 (7) 


1.9 


62.2 


11 


38 


76 59 


45 


69 


The Gambia 


Basse 


Medical Research 
Council (MRC) 


Rural 


5 


29 076 


310 


123 (37) 


1.2 


ND 


9 


19 


77 46 


38 


90 


Mozambique 


Manhiga 


Centra de 

Investigagao em 
Saude de 
Manhiga (CISM) 


Rural 


5 


15 380 


210 


1 58 (24) 


12.2 


269.7 


4 


41 


24 14 


33 


72 


Kenya 


Nyanza 
Province 


CDC/Kenya Medical 
Research Institute 
(KEMRI) Research 
Station/CDC 


Rural 


11 


21 603 


390 


1 23 (37) 


6.7 


3.9 


6 


31 


46 43 


15 


73 


India 


Kolkata, 
W. Bengal 


National Institute of 
Cholera and 
Enteric Diseases 
(NICED) 


U rb8n 


2 


13416 


530 


87 (54) 


ND 


1 .7 


16 


46 


96 58 


22 


70 


Bangladesh 


Mirzapur 


International Center 
for Diarrheal 
Disease 
Research, 
Bangladesh 
(ICDDR.B) 


Rural 


1 


25 560 


400 


69 (62) 


ND 


0.4 


10 


45 


72 39 


35 


85 


Pakistan 


Karachi (Bin 
Qasim 
Town) 


Aga Khan University 


Peri urban 


7 


25 659 


470 


103 (47) 


0.1 


0.8 


13 


37 


87 35 


33 


67 



Abbreviations: CCS, case/control study; CDC, Centers for Disease Control and Prevention; DPT3, complete coverage with diphtheria-pertussis-tetanus vaccine; GNI, gross national income; HIV, human 
immunodeficiency virus; ND, no data; ORS, oral rehydration solution; SHC, sentinel health centers where children with moderate-to-severe diarrhea were enrolled in the CCS; U5MR, under-5 mortality rate. 
a All data pertain to 2003, with the exception of access to improved water and adequate sanitation, which pertain to 2002 [42], and the population <5 years, as described below. 
b Value is calculated per 1000 live births and ranked out of 192 countries for 2003 [42]. 

c The population <5 years of age represents the median value from sequential demographic surveillance system rounds conducted during the case/control study. 
d Prevalence of HIV (percentage) among 15- to 49-year-olds, as of end of 2003 [42]. 

8 Standardized reported malaria rate per 1000 population, 2003 for all countries but Kenya (2002) [43]. 
f Percentage of children <5 years of age with wasting or stunting graded as moderate or severe [42]. 

9 Data shown pertain to urban areas when the study site is urban sites and rural areas when the site is rural. Data for rural areas were considered most appropriate to represent the study site in Pakistan [42]. 
h Percentage of children <5 years of age with diarrhea receiving oral rehydration and continued feeding 1 994-2003 [42]. 

1 Percentage of children who received DPT3 by 1 year of age 142] . 



least intermittent internet transmission, and the ability to ship 
specimens and strains abroad had to be available, with capa- 
bilities to perform coprocultures, antigen-detection tests, and 
nucleic-acid based assays. 

Establishing a Sampling Frame for the Case/Control Study and 
Selecting Health Centers for Case Recruitment 

The census at each site will enable population-based estimates 
of the outcomes of interest. Each census was continually 
updated using a demographic surveillance system (DSS) in 
which the households were visited every 4-6 months to record 
pregnancies, births, deaths, and migrations in and out of the 
area. Between DSS visits, we enlisted a community reporter 
from each neighborhood to meet weekly with local leaders (re- 
ligious figures, political representatives, and elders) and mid- 
wives to detect births and deaths among children 0-59 
months of age. The reporter visited near-term pregnant 
women as an additional means of capturing births. Keeping 
the DSS current was necessary to maintain an accurate sam- 
pling frame from which to select matched community controls 
for the case/control study, and for the timely performance of 
verbal autopsies, as described below. 

In preparation for the case/control study, we performed a 
Health Care Utilization and Attitudes Survey (HUAS). An 
age-stratified sample of approximately 1000 children aged 
0-59 months per site randomly selected from each updated 
DSS dataset was visited at home, and parents/primary caretak- 
ers were asked whether their child had experienced diarrhea 
during the previous 14 days. If so, the presence of findings 
suggestive of MSD was solicited (sunken eyes, wrinkled skin, 
hospitalization, receipt of intravenous hydration, or dysen- 
tery), and source(s) of healthcare were recorded. These data 
were used to adjust the size of the DSS population at each site 
as necessary to contribute the requisite number of cases of 
MSD to each age stratum, and to select 1 or more "sentinel" 
health centers (SHCs) serving the DSS population at each site 
(Table 1) as venues for the case/control study based on their 
potential to capture MSD cases from the DSS. 

During the second and third years of the case/control study, 
an abbreviated HUAS questionnnaire (designated "HUAS- 
lite") was administered to caretakers of approximately 1000 
randomly selected children aged 0-59 months (age- 
stratified) approximately every 4 to 6 months in association 
with the DSS interviews. HUAS-lite data were used to refine 
the selection of SHCs, to estimate the extent to which children 
with MSD who seek care at SHC are representative of children 
with MSD in the DSS population (by comparing features of 
those who do and do not seek care), and to calculate the pro- 
portion of children with MSD who sought care at the SHCs at 
each site (r value) as a means of extrapolating the overall and 
pathogen-specific MSD episodes enumerated at the SHCs to 



derive the incidence estimates for the entire DSS population 
(see Blackwelder, et al, this supplement). 

Process Development and Training 

Paper case report forms (CRFs) were created and translated 
into the 4 languages spoken by the interviewers (English, 
French, Portuguese, and dual Dholuo and English) according 
to preference of the local study teams. Interviews were always 
conducted in the native language of the respondent. Initial 
versions of the CRFs were field tested, then modified as 
needed at a 4-day study development meeting attended by 
each site's senior clinical investigators and study coordinators. 

A pilot case/control study was conducted for approximately 
3 months followed by the full, 36-month case/control study. 
Before the pilot and full-study initiations, we conducted a 
5-day training program at each site, using interactive adult 
learning techniques with group participation, role playing, 
small group practice sessions, and evaluations of competency. 
We compiled an interviewers' and a supervisors' manual of 
procedures which served as the basis for training sessions. The 
curriculum covered the principles of human subjects research 
and elements of good clinical practices [10], how to conduct 
an interview (eg, issues of privacy, building rapport with the 
respondent, and asking questions in a nonjudgmental way), 
perform a focused physical examination, collect, process, and 
transport stool specimens, and document observations of 
water and sanitation facilities. The meaning of each question 
and response choice was discussed. Terms were defined, using 
pictures and graphics whenever applicable. Participants prac- 
ticed a standardized format for handwriting English letters 
and numbers to reduce frequency of errors in data recording 
and entry. The supervisors' manual and training focused on 
supportive supervision techniques, training, handling under- 
performing staff, quality management, tracking study activi- 
ties, and performing oversight, spot checks, and reinterviews 
to ensure the validity and reliability of the data. 

We enlisted the assistance of an experienced anthropomet- 
rist to train the clinical and field staff at 1 site in Asia and 1 
site in Africa in obtaining length/height, weight, and mid- 
upper arm circumference (MUAC) measurements. These 
3-day training sessions also served the purpose of training the 
Epidemiology Team from the core site at the Center for 
Vaccine Development (CVD), University of Maryland, Balti- 
more (K. L. K., D. N., and T. H. F.), who then conducted 
similar training at the remaining 5 sites. On the third day of 
training, 10 children (5 aged 0-23 months and 5 aged 24-59 
months) participated in a standardization session in which 
each trainee performed 2 independent measurements of the 
length/height and MUAC of each child. Intrarater reliability 
and validity were calculated using the anthropometrist (and 
later the CVD epidemiologist) as the "gold standard." 
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A difference of >0.5 cm was considered unacceptable when 
comparing a trainee's 2 measurements of the same child or when 
comparing the trainee's and the gold- standard measurements 
of the same child. Trainees with unacceptable performance 
were retrained until competency was achieved. A gold- 
standard measurer was identified at each site to supervise field 
measurements and to train all staff including newly hired staff 
every 4-6 months. Technical error of measurement and 
average bias will be calculated to assess inter- and intraob- 
server reproducibility as well as validity of measurements [11]. 

Scientific Oversight 

We recognized that controversies persist regarding the most 
appropriate case definitions and detection methods for study- 
ing diarrhea, and that the approach chosen would impact the 
resultant estimates of disease burden [12, 13]. Consequently, 
as part of a consensus-building process, we assembled a 
Steering Committee on Epidemiologic and Clinical Issues 
comprising the lead investigators from each site, and a multi- 
national group of 6 experts in diarrheal disease. The com- 
mittee vetted the clinical protocol at the initial meeting. 
Thereafter, the committee was convened annually and on an 
ad hoc basis as issues arose. Once the study was initiated, ex- 
ternal experts were assembled to form a Steering Committee 
on Nutritional Issues and a Steering Committee on Biostatisti- 
cal Issues to review the analysis plan and to provide guidance 
as issues arose. In the final months of the study, an Interna- 
tional Strategic Advisory Committee was formed to critically 
review the methodology and results and to advise the funding 
agency about the significance of the findings to inform its stra- 
tegic planning for the future (Farag et al, this supplement). 

Case Definition of MSD and Other Study Outcomes 

The initial step in eligibility screening was the selection of 
children who fulfilled the WHO definition of diarrhea (>3 ab- 
normally loose stools in 24 hours [12]). In subsequent steps 
we identified cases of MSD, the primary outcome of interest, 
intending to capture diarrheal illnesses that would not be ex- 
pected to resolve spontaneously without medical intervention 
or without sequelae, because these illnesses constitute priori- 
ties for development of vaccines and other new or improved 
preventive and therapeutic strategies. We reasoned that epi- 
sodes that would qualify as MSD fell into 2 general categories: 
(1) those accompanied by dehydration to a degree that the 
child's survival would likely depend on access to life-saving 
rehydration fluids, and (2) those with evidence of inflammato- 
ry destruction of the intestinal mucosa, thereby at increased 
risk for disabling sequelae (such as persistent diarrhea [14] 
and stunting [15]) or death [16, 17]. 

To capture children who had potentially life-threatening di- 
arrheal dehydration, we adapted the WHO definition of 



dehydration to our case definition of MSD [18, 19], choosing 
the most objective signs (sunken eyes more than usual and 
slow or very slow recoil after an abdominal wall "skin pinch"). 
In addition, we included the determination by a healthcare 
provider that the severity of dehydration warranted adminis- 
tration of intravenous fluids. Although not part of our case 
definition, other signs of dehydration proposed by WHO were 
documented, including restlessness or irritability and drinking 
eagerly or appearing thirsty (considered to be signs of "some" 
dehydration), and lethargy, loss of consciousness, inability to 
drink, or drinking poorly (as signs of "severe" dehydration). 
During analysis we will explore the impact on the study find- 
ings of including these other signs of dehydration in the defi- 
nition of MSD. We considered adopting as inclusion criteria 
elements of systems used widely to define severe illness in ro- 
tavirus vaccine trials [20-22]. However, many of the compo- 
nents, such as total duration and maximum severity of 
diarrhea, vomiting, and fever, can only be determined in ret- 
rospect when the episode is resolving or resolved, at which 
point the decision to include a child in GEMS would already 
have been made. Instead, our approach has been to collect this 
information for exploration during analysis. 

To capture children with evidence of diarrheal diseases 
caused by inflammation and mucosal injury in the case defini- 
tion, we enrolled children with dysentery. Because there is no 
marker to predict which cases of dysentery are likely to experi- 
ence clinically significant intestinal damage, we included all 
children with diarrhea who passed at least 1 stool containing 
visible blood according to either the caretaker or the clinician. 
Finally, we included children with diarrhea who appeared suf- 
ficiently ill to prompt the healthcare provider to recommend 
overnight admission to the hospital. 

We restricted enrollment to children with acute MSD (<7 
days' duration) to maximize the opportunity to identify the 
inciting pathogen and to collect new episodes that can be used 
together with DSS and HUAS data to estimate annual inci- 
dence rates. We defined an episode of diarrhea as days with 
diarrhea beginning after at least 7 diarrhea-free days and 
ending when diarrhea is not present for 7 days [23, 24]. Al- 
though the WHO definition of a new episode of diarrhea re- 
quires only 3 diarrhea-free days [12], we chose a longer 
interval (as have other investigators [12, 25]) to increase our 
margin of certainty that the episode was new, recognizing that 
this approach could underestimate the incidence of MSD. 

Case Ascertainment 

Cases of MSD were identified in SHCs (hospital, urgent care 
facilities, and community clinics) to capture those illnesses 
that are most severe and that collectively constitute a signifi- 
cant cost in healthcare services, and thus would be targeted 
for prevention by vaccines and other interventions (Figure 1). 
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Define Catchment Population 



• DSS serial surveys conducted to update the census 

• HUAS-lite serial surveys to characterize health care utilization practices tor childhood diarrheal disease 



I 

Registration 



Detecting 
Fatalities 



CASES 

Record all visits among children 
0-59 months of age from the DSS 
seeking care at the SHC 
Reter those with diarrhea tor 
eligibility determination 



CONTROLS 

• Record all potential control 
children randomly selected from 
the DSS 



T 



Enrollment 



If death is detected 
during enrollment 
encounter 

• Record cause of 
death (clinician 
interview, medical 
chart, and death 
certificate) 

• Refer to DSS 
team for verbal 
autopsy 



CASES > 

Enroll 8-9 cases per fortnight in 
each age stratum at the SHC: 
follow until discharge 

• Determine eligibility 

• Interview caretaker 
demographic, epidemiologic, and 
clinical history, health care 
utilization and expenses 

• Record clinical observations and 
events, physical findings, stool 
features anthropometric 
measurements, clinical 
management and outcome 

• Collect and process stool sample 
v (and rectal swab if applicable) . 



CONTROLS > 

Enroll 1-3 matched controls from 
the community for each case 

• Determine eligibility 

• interview caretaker demographc 
and epidemiologic history 

• Obtain anthropometric 
measurements and clinical 
observations 

• Collect and process stool sample 



Memory Aid 



if death is detected 
at 60 day visit: 

• Record cause of 
death (clinician 
interview, medical 
chart, and death 
certificate if 
available) 

• Refer to DSS team 
for verbal autopsy J 



Caretaker completes form to document occurrence of diarrhea for 14 days 




t 60-day Follow-up Visit i 


t 



• Interview caretaker child's vital status, clinical condition and interim illnesses 

• Perform focused physical exam and anthropometric measurements 

• Document water, sanitation, and hygiene practices via interview/observation 

• Review and collect Memory Aid to determine diarrhea duration, as applicable 



Figure 1. Flow diagram illustrating major study activities. Abbreviations: DSS, demographic surveillance system; SHC, sentinel health center; HUAS, 
Health Care Utilization and Attitudes Survey. 



GEMS staff were situated in the intake area at each SHC to 
complete a registration log documenting each visit made by a 
child 0-59 months old belonging to the DSS. The GEMS reg- 
istrar was given access to the DSS database to verify that a 
child belonged to the DSS, and to record each enrolled child's 
unique DSS number as a means for determining, at a later 
date, who was enrolled into GEMS more than once. Each visit 
was assigned a unique screening identification number, and 
the registrar recorded the date and time the child entered the 
SHC; the child's age, sex, and village/neighborhood; whether 
the child had diarrhea; and whether the child was hospital- 
ized. The GEMS registrar referred all children from the DSS 



who were aged 0-59 months and had diarrhea to a GEMS cli- 
nician. The clinician informed the parent/primary caretaker 
about the study, determined the child's eligibility (Table 2), 
and obtained informed consent. If an eligible child was not 
enrolled, the reasons for nonenrollment were documented (eg, 
refusal, missed opportunity, stool sample inadequate or not 
obtained, 14-day quota filled, or child died before enrollment). 

Each site aimed to enroll approximately 220 MSD patients 
per year into each of 3 age strata: 0-11 months, 12-23 
months, and 24-59 months, totaling 1980 cases over 3 years. 
To ensure even sampling throughout the year, the target was 
to enroll approximately 8-9 cases per age stratum (25-26 
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Table 2. Inclusion Criteria for Cases 



Table 3. Inclusion Criteria for Controls 



1 . Child is 0-59 mo of age 

2. Child belongs to the demographic surveillance system 
population at the site 

3. Child is not currently enrolled as a case (meaning previously 
enrolled and pending 60-day visit) 3 

4. Child meets case definition of diarrhea (>3 abnormally loose 
stools in the previous 24 h) 

5. Diarrhea episode is: 

• Acute (onset within 7 d of study enrollment) and 

• Represents a new episode (onset after >7 diarrhea-free 
days) [23, 24] 

6. Diarrhea is moderate-to-severe, meaning that the child met at 
least 1 of the following criteria: 

• Sunken eyes, confirmed by parent/primary caretaker as 
more than normal 

• Loss of skin turgor (determined by abdominal skin pinch 
(slow return [<2 s] or very slow return [>2 si) 

• Intravenous rehydration administered or prescribed 

• Dysentery (visible blood in a loose stool) 

• Hospitalized with diarrhea or dysentery 



a A child was eligible to be enrolled as a case irrespective of whether he or 
she had been included as a case or as a control previously; whereas cases 
were eligible for reenrollment only after the 60-day follow-up visit had been 
completed, controls could be enrolled as a case at any time they met the 
criteria. 



cases overall) per fortnight. This strategy prevented the strata 
from being filled prematurely in seasons with high volume 
and respected the capacity limitations of the clinical and mi- 
crobiology personnel, but because all DSS children with MSD 
were recorded, temporal increases in the case load of MSD 
and of specific diarrheal pathogens could be measured. Analy- 
ses for events that might have seasonal variation will take into 
account the sampling fraction of MSD for each period. 

Control Selection 

For each child with MSD included in the study, we enrolled 
1-3 control children without diarrhea from the DSS commu- 
nity (Figure 1) within 14 days of presentation of the index 
case. Sites tracked their ability to fill each age stratum on a 
fortnightly basis and followed an algorithm to determine the 
number of controls to enroll: 1:1 casexontrol matching if 7-9 
cases were enrolled; 1:2 matching if 4-6 cases were enrolled, 
and 1:3 matching if <3 cases were enrolled. At least 4 children 
who met the matching criteria (Table 3) were randomly select- 
ed from the DSS database as potential controls. A field worker 
visited the home of selected children sequentially and ex- 
plained all aspects of the study. If the parent/primary caretaker 
expressed interest and the child met eligibility criteria 
(Table 3), informed, written consent was obtained and ar- 
rangements were made to collect a stool sample, as described 



1 . Resides in demographic surveillance system area 

2. Matched to the index case as follows: 

• Age: 

o ±2 mo for cases 0-1 1 mo 
o ±4 mo for cases 1 2-59 mo 

o May not exceed the stratum boundaries of the case, eg, 
a control for an 1 1-mo-old case must be between the 
ages of 9 and 1 1 mo and a control for a 1 3-mo-old must 
be between the ages of 12 and 17 mo 

• Same sex 

• Residence: lives in the same or nearby village/neighborhood 
as the case 3 

• Time: enrolled within 14 d of presentation of the case 

3. No diarrhea in the previous 7 d b 

a Each site followed an algorithm beginning with the case's village/ 
neighborhood, and then proceeding to villages/neighborhoods located at an 
increasing distance from the case's village/neighborhood until a control could 
be identified. 

b Control children will be included in the analysis irrespective of whether they 
developed diarrhea after enrollment. 



below. Reasons for not enrolling a selected child were docu- 
mented (eg, refusal, not found at home after 3 attempts to 
contact, or failed to produce an adequate stool sample). 

Data Collection at Enrollment From Cases and Controls 

Case enrollment interviews took place at the SHC whereas 
control caretakers were interviewed at home. To facilitate 
linkage of our results with existing databases, we designed our 
caretaker interviews to include questions found in the primary 
sources of population-based data used to estimate child mor- 
tality in developing countries, such as the UNICEF-supported 
Multiple Indicator Cluster Surveys and the US Agency for In- 
ternational Development-supported Demographic and Heath 
Surveys [1]. Demographic information collected about the case 
or control and his/her household (defined as a group of 
people who share a cooking fire) included maternal education 
and household size (including the number of children <5 
years old). Building materials and household possessions were 
documented (to assess potential risk factors for illness and as 
indicators for constructing a wealth index for each site [26]). 
Questions addressed handwashing practices and access and 
availability of improved water and sanitation facilities [27], 
animals on the premises, water treatment, sharing sanitation 
facilities, and disposal of the child's feces. The caretakers were 
queried about the child's clinical signs and symptoms; how 
the illness was managed prior to the SHC visit (the reference 
point was the current illness for cases and the most recent di- 
arrheal illness for controls), for example, use of oral rehydra- 
tion solutions, zinc, antibiotics, traditional medicines, 
continued feeding and fluid administration; healthcare seeking 
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behavior; and breastfeeding practices. The household's direct 
(out-of-pocket) and indirect (eg, income lost while caring for 
the sick child) expenditures at home and at the SHC were tab- 
ulated. The GEMS staff measured the child's axillary digital 
temperature, respiratory rate (the average of 2 measures ob- 
tained using a rate counter), anthropometric dimensions (de- 
scribed below), and clinical signs of malnutrition (bipedal 
edema, wasting, flaky skin, and sparse or loose hair). 

A clinician examined all cases to document signs of dehydra- 
tion, including skin pinch return (graded as slow <2 seconds or 
very slow >2 seconds), sunken eyes (more than usual confirmed 
by the parent/primary caretaker), dry mouth (graded as some- 
what or very dry), and mental status changes, and examined 
the child's rectum for signs of prolapse. A member of the clini- 
cal team examined the child's stool (if available) for visible 
blood and recorded any rehydration fluids, zinc, and antibiotics 
prescribed or administered at the SHC. Cases who remained in 
the SHC while receiving rehydration fluids were reweighed at 4 
hours and again at discharge from the SHC, as applicable, at 
which points the clinician reassessed the child for signs of de- 
hydration and determined his/her vital status and weight. 

Collection and Processing of Stool Specimens 

To qualify for enrollment, each case and control had to 
produce a whole stool specimen that weighed at least 3 grams. 
In one site (Kolkata), stool is routinely collected from hospi- 
talized children by passing a small catheter into the child's 
rectum and aspirating loose stool using a syringe attached to 
the other end [28]; at all other sites, whole stool was passed 
naturally per rectum. Cases were required to provide a whole 
stool specimen within 12 hours of registration at the center. 
To collect stool from control children at home, study staff pro- 
vided the caretaker with a polystyrene foam container contain- 
ing a cold pack, a culturally accepted stool collection device 
(such as a plastic "potty"), plastic gloves, a specimen cup, and 
a scoop. The field worker returned to the household the next 
morning (or sooner if called by the parent) to retrieve the 
stool sample and perform the study interview. Because chil- 
dren usually defecate in the morning, and since families fre- 
quently used cellular phones to alert the GEMS field team that 
the child had produced a stool, we were able to fulfill the 
study requirement of retrieving and processing freshly passed 
stools from cases and controls within 6 hours of evacuation. 
Processing involved inserting 2 cotton-tipped swabs into the 
specimen (if dysentery was present, an area of blood or mucus 
was swabbed); one swab was placed into modified Cary-Blair 
transport medium [29], and the other into buffered glycerol 
saline [30]. Remaining whole stool was retained in an empty 
vial. The processed sample was placed immediately into either 
a specimen refrigerator or a polystyrene foam container con- 
taining a fresh cold pack, to be delivered to the laboratory and 



plated within 24 hours. Stools were evaluated for bacterial 
pathogens (eg, Salmonella, Shigella, Campylobacter, Aeromo- 
nas, and Vibrio species, and 5 diarrheal pathotypes of Escher- 
ichia coli), protozoal agents {Entamoeba histolytica, Giardia 
lamblia, and Crytosporidium species), and viruses (rotavirus, 
adenovirus, norovirus, sapovirus, and astrovirus) using micro- 
biologic methods described elsewhere in this supplement (see 
Panchalingam et al, this supplement). 

If antibiotics were to be administered to cases before the 
whole stool specimen was collected, 2 rectal swabs also were 
obtained. The cotton tip was moistened with transport media, 
gently inserted into the child's rectum, rotated 360°, and im- 
mediately inserted into transport media, as described above 
for whole stool swabs. Only swabs stained or covered with 
fecal material were accepted by the laboratory. This strategy 
permitted collection of an adequate sample for bacteriology 
(ie, rectal swabs) prior to antibiotic administration as well as a 
whole stool for identification of pathogens that are best detect- 
ed in whole stool but are not expected to be affected by antibi- 
otic administration (see Panchalingam et al, this supplement). 

Memory Aid for Recording Diarrheal Episodes in Cases and 
Controls During the 14 Days After Enrollment 

We created a memory aid suitable for use by adults regardless 
of literacy (Figure 2). The data will be used to detect the oc- 
currence of persistent diarrhea in cases and to explore 
whether the inclusion of control children who developed diar- 
rhea within 7 days after enrollment impacted the association 
between specific pathogens and MSD. The tool was developed 
in collaboration with a representative from the Malian Office 
of Literacy and modified in response to focus groups and field 
testing at each site. After receiving training at the enrollment 
visit, each day for the next 14 days the parent/primary caretak- 
ers marked whether the child had normal stools only, or diar- 
rhea (passage of >3 abnormally loose stools in the previous 
24 hours). The aid was reviewed with the caretaker at the 60- 
day follow-up visit to resolve missing or unclear markings and 
then collected. Diarrhea that continued unabated through day 
14 will be termed "persistent diarrhea"; diarrheal episodes that 
continued beyond day 14 (the last day the memory tool col- 
lected data) were not systematically tracked. 

Clinical and Epidemiologic Data Collected at the Single 
Household Follow-up Visit 

GEMS field workers visited the household of each case and 
control child approximately 60 days after enrollment (accept- 
able range, 50-90 days). They assessed vital status, recorded 
interim medical events, took the child's axillary temperature, 
and performed anthropometric measurements. They directly 
observed the household's drinking water sources, storage con- 
tainers, and treatment practices, and tested the water for 
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Please complete this form every day for each of the next 14 days. 



1 Each morning when you wake up decide whether your child had diarrhea during the previous 
day Diarrhea means that your child passed 3 or more loose or watery stools that were not 
normal for him or her on that day 

2 Go to the correct day "o" means today "oo" means tomorrow, and so on A day begins when 
you wake up in the morning and ends when you wake up the next morning. 

3 If your child had diarrhea that day, mark "X" in the dark box for that day [X] If your child did not 
have diarrhea, mark "X* in the white box for that day [X] Each day, make only one "X". 

4 If you forget a few days, try to start again on the correct day 

5 Keep this form in a safe place We will come to your house to collect it in 60 days 



DIARRHEA 



NORMAL 



O (today) 








oo 








ooo 








oooo 








ooooo 








oooooo 








aoooooo 








oooooooo 








ooooooooo 








oooooooooo 








ooooooooooo 






oooooooooooo 








ooooooooooooo 








oooooooooooooo 





Figure 2. Memory aid completed by the caretaker to document the occurrence of diarrhea for 14 days after enrollment of cases and controls. 



chlorine if the household reported that they treated it. They 
examined the sanitation facilities and noted whether fecal con- 
tamination was present, and observed hygiene indicators, such 
as the proximity of soap to the hand washing station. 

Anthropometric Measurements 

Weight, length/height, and MUAC were measured for each 
case and control at enrollment and at the 60-day follow-up 
visit as previously described [31]. Weight (to the nearest 0.1 kg) 
was recorded prior to administration of rehydration fluids 
with the child naked or in light clothing using a digital scale 



that was calibrated at least weekly (model 314, Tanita Corp of 
America, Arlington Heights, Illinois); for children 0-23 
months of age, the weight of the mother alone and with the 
child was recorded, and the child's weight was computed 
during analysis. The length of children 0-23 months of age or 
those who were older but unable to stand unassisted was mea- 
sured (to the nearest 0.1 cm) in the recumbent position using 
a board with a fixed head and sliding foot piece (Shorr Pro- 
ductions, Olney Maryland). The same apparatus was used to 
measure standing height in children 2 years of age and older. 
A 25-cm paper single-slotted insertion tape was used to 
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measure MUAC to the nearest 0.1 cm (Shorr Productions). 
Length/height and MUAC were each measured thrice; the 
average will be calculated during analysis [32]. 

HIV Substudy 

In appreciation of the importance of HIV infection on the 
incidence and outcomes from diarrheal disease, including an 
increased likelihood of dying from an episode of diarrhea 
compared with HIV-infected children [33, 34], we considered 
including systematic HIV testing as part of the initial study 
design but concluded that it was beyond the scope of our ca- 
pabilities. As the study progressed, national guidelines for pro- 
vider-initiated counseling and testing were adopted at the 
Kenya and Mozambique study sites (the only 2 GEMS study 
sites with high HIV seroprevalence in adults), and home- 
based counseling and testing has been implemented at the 
Kenya site. As a result, during the last 2 years of GEMS, we 
incorporated voluntary HIV testing or the ability to link to 
existing HIV test results of mothers and children into the 
study protocol at these 2 sites. Informed consent was obtained 
to link HIV test results (for participating child and his/her 
mother) to GEMS data. We will compare frequency, out- 
comes, and etiologies of episodes of diarrheal diseases among 
infected and uninfected children born to infected mothers, 
and among uninfected children born to uninfected mothers. 

Detection of Deaths and Performance of Verbal Autopsy 

Two parallel systems were in place at all sites to detect deaths. 
The GEMS team ascertained deaths among children enrolled 
in the case/control study during the enrollment encounter and 
at the 60-day follow-up visit. Concomitantly, the DSS teams 
identified all under-5 deaths regardless of enrollment status. In 
either case, the DSS team obtained a verbal autopsy using WHO 
standardized questionnaires with minor modifications [35]. 
Local customs were followed to respect the mourning period 
after which a family could be contacted. Whenever possible, 
information on the cause of death was collected from the 
medical chart, the healthcare provider, and the death certifi- 
cate for use as a means to validate the results of the verbal 
autopsy [36]. A uniform algorithm will be used across all sites 
to determine the cause of death. The mortality associated with 
diarrhea and dysentery among enrolled and nonenrolled chil- 
dren will be calculated. 

Sample Size Considerations 

A sample size at each site of approximately 600 analyzable 
cases and 1-3 matched controls per stratum was chosen to 
provide 80% power (2-sided a =.05) for site stratum-specific 
comparison of the proportion of cases and controls in whom 
a specific enteropathogen is identified, if a specific pathogen is 
identified in at least 5.8% of cases and 2.5% of controls. In the 



event that the proportion of cases with a specific pathogen 
exceeds 5.8%, the absolute difference between cases and con- 
trols needed to achieve statistical significance increases. For 
example, this sample size will give 80% power to find a signifi- 
cant difference if the proportion is 9.8% in cases vs 5.5% or 
less in controls. To compensate for dropout, migration, and 
other losses to follow-up of up to 10%, we planned to enroll a 
total of 660 cases per stratum per site to achieve the desired 
number of analyzable cases and controls. 

Ethical Considerations and Oversight 

GEMS was designed as an observational study that confers 
minimal risk, and is expected to generate information that can 
be used by the scientific, public health, policy, and healthcare 
provider communities to improve the prevention and treat- 
ment of diarrheal diseases in the future, both at the site level 
and globally. Each site was expected to follow WHO guide- 
lines for the clinical diagnosis and management of diarrheal 
disease, which represent a universal standard of care [18]. We 
provided supplementary funding for procurement of medical 
supplies (eg, oral rehydration solution, antibiotics, intravenous 
cannulae, and fluids) to be used to treat patients with diarrhea 
at the discretion of each participating SHC. We did not 
attempt to systematically introduce newer aspects of diarrhea 
management, such as low-osmolality oral rehydration solution 
and zinc, in sites lacking national policies to guide usage and 
trained health providers to administer these products [37]. At 
the time of study initiation, no site routinely performed the 
spectrum of assays provided by GEMS to detect potentially 
treatable pathogens (bacterial culture and immunoassays for 
protozoa). Therefore, the sites were expected to ensure timely 
provision of the GEMS results to the clinicians for use in case 
management. We shared interim results (eg, distribution of 
pathogens, management of diarrhea, and sequelae) with the 
investigators and the international community annually at in- 
vestigators' meetings and at scientific conferences, and each 
site received a cleaned dataset each year that could be used for 
more detailed exploration. 

The clinical protocol, consent forms, CRFs, and other sup- 
porting documents were approved prior to initiation of the 
study by the ethics committees and applicable scientific review 
boards at the University of Maryland School of Medicine, and 
the committees overseeing each site and their collaborating 
partners from other institutions. Amendments and annual 
reports underwent ethics committee review. Consent forms 
were translated into 11 local languages and modified accord- 
ing to the standards at each site; full approval of the University 
of Maryland ethics committee required back-translation into 
English and certification by an independent bilingual speaker 
that the 2 versions were identical. Individual, informed 
consent was obtained from the parent/primary caretaker of 
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each participant prior to study activities. When the person 
supplying consent was illiterate, an impartial third party wit- 
nessed the consent process and signed the consent document. 
Some sites additionally obtained "community consent" from 
local leaders who were convened in a public forum to discuss 
the study aims, procedures, potential risks, and benefits. 

Data Flow, Management, and Analysis 

A data coordinating center (DCC) was responsible for central- 
ized data management as described elsewhere (see Biswas et al, 
this supplement). In brief, sites transmitted completed CRF 
pages to the DCC using a variety of electronic formats, but 
primarily by secure file transfer protocol (SFTP). Although the 
CRFs were printed in different languages, the structure of the 
fields was maintained to permit generation of a single database 
containing data from all sites. The DataFax software system 
(Clinical DataFax Systems, Hamilton, Ontario, Canada) was 
used to build and manage the master database and aided in 
the electronic validation process based on character recogni- 
tion software. Timelines for transmission of data, data queries, 
and query resolution were established. A system of security 
measures and backup procedures preserved the integrity of the 
data and ensured restoration capabilities. 

The GEMS analytic plan (see Blackwelder et al, this supple- 
ment) addressed 3 main goals: (1) to determine the major 
pathogens responsible for MSD, taking into account the prev- 
alence of each pathogen, the frequency of asymptomatic infec- 
tion in controls, and the presence of multiple pathogens; (2) 
to determine the pathogen-specific attributable fraction of 
MSD by age within each site and to extend these estimates to 
the DSS population; and (3) to identify independent risk 
factors, including demographic, environmental, and socioeco- 
nomic factors as well as pathogens, for MSD and other out- 
comes of interest (especially death and child growth) using 
multivariable models. 

Quality Management 

Activities to ensure high-quality data collection included in- 
depth training followed by assessment of competency using a 
variety of techniques, such as written tests and observations 
(with feedback) during training sessions. To control the 
quality of data entry, a field supervisor at each site reviewed all 
completed CRFs daily for legibility, completeness, and consis- 
tency. The supervisor's signature indicating that all discrepan- 
cies were resolved was required for submission to the DCC. 
Quality control at the DCC to detect missing data, missing 
forms, out-of-range values, and data inconsistencies is de- 
scribed elsewhere (see Biswas et al, this supplement). 

Supervision and oversight were maintained for quality 
assurance purposes. Supervisors utilized growth charts and 
predefined criteria to identify (in real time) aberrant 



measurements that should be repeated, such values that were 
lower at 60 days compared to enrollment. Clinical and field 
supervisors performed random reinterviews to ensure the va- 
lidity of the data collected by the GEMS clinicians and field 
workers. The CVD epidemiology team visited each site at least 
twice per year to observe study activities, review the regulatory 
files, randomly inspect consent forms and CRFs, and retrain 
as necessary. They provided a written feedback to the site and 
the CVD investigators. They maintained at least weekly 
contact with the teams with the use of email, internet calls, 
and teleconferences. A regulatory affairs specialist at the CVD 
oversaw the quality, timeliness, and completeness of submis- 
sions to each relevant institutional review board, and ensured 
that each site was compliant with US regulatory requirements. 
Sites reported all protocol deviations to the CVD team and a 
corrective action plan was developed jointly. 

DISCUSSION 

GEMS is the largest and most comprehensive case/control 
study of acute diarrhea conducted to date, and will, with its 
complementary components (HUAS-lite and DSS), provide 
information about the incidence, microbiologic etiology, risk 
factors, and adverse clinical outcomes of moderate-to-severe 
diarrheal episodes among infants and young children living in 
regions of the world where 82% of under-5 deaths occur [2]. 
GEMS employed standardized data collection instruments and 
epidemiologic methods across diverse developing country set- 
tings that vary with respect to health indicators, access to and 
quality of affordable healthcare, economic development, and 
environmental conditions, so the results will be broadly appli- 
cable and can be used to augment existing disease burden 
models and to define the factors likely to influence the 
outcome of diarrheal disease in the future. The generalizability 
of the results should be further enhanced by employing case 
definitions and study methods that were accepted by experts 
in the field and disclosed in a detailed and transparent way. 
GEMS will provide a detailed characterization of MSD accord- 
ing to its clinical manifestations and adverse effects on child 
health. The attributable fraction contributed by each pathogen 
that is significantly associated with MSD in the case/control 
study then will be quantified. This process will produce a list 
of enteropathogens that should be prioritized for public health 
interventions. In addition, GEMS will provide the serologic, 
antigenic, and genotypic characteristics of the major etiologic 
agents, information needed to develop vaccines and other in- 
terventions that can be used in decades to come. We have laid 
the groundwork for building cost-effectiveness models to 
justify the introduction of selected interventions into countries 
where GEMS was undertaken by describing the economic 
burden of diarrheal diseases. 
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By conducting the GEMS case/control study within a dem- 
ographically characterized population whose healthcare utili- 
zation practices have been characterized, we are also able to 
derive population-based estimates of MSD incidence and 
other outcomes of interest. Repeated HUAS-lite interviews of 
a representative sample of caretakers over a 2-year period 
provide the proportion of children in the DSS population who 
seek care at the SHC when they develop MSD (the r value). 
Because we are measuring the number of MSD cases from the 
DSS who visit the SHC each year, we can divide by r to esti- 
mate the number of MSD cases in the DSS population as a 
measure of incidence. Furthermore, we can use odds ratios 
from the GEMS case/control study to calculate population at- 
tributable fractions for each pathogen found to be associated 
with MSD by conditional logistic regression adjusted for the 
presence of other pathogens (see Blackwelder et al, this 
supplement). 

Some limitations of GEMS are noteworthy. First, although 
designed as an observational study, the resources, infrastruc- 
ture, training, and frequent visits to the DSS households pro- 
vided by GEMS may well have altered the natural history of 
diarrheal diseases in our study populations. These secondary 
health benefits must be considered in interpreting the 
outcome and sequelae of diarrheal diseases that are found in 
GEMS. Another limitation relates to our ability to use the 
case/control study to derive population-based estimates of 
MSD incidence and other outcomes of interest. The validity 
of these estimates will depend on 2 factors. One is the ability 
of caretakers to accurately report that their child had findings 
indicative of MSD during the previous 14 days. We attempt- 
ed to quantify this limitation by conducting a nested study 
to compare the caretakers' determination of MSD with those 
of the SHC clinician and found good agreement (k statistic 
for interobserver agreement = 0.82 for sunken eyes and 0.64 
for wrinkled skin, data not shown). The second factor is the 
need for a high r value to achieve precise estimates and to 
increase the likelihood that the children enrolled in the case/ 
control study indeed represent those with MSD in the DSS 
population. For this reason, we endeavored to select the 
SHCs most likely to capture diarrheal diseases at each site; 
however, despite our efforts, it was generally not possible to 
achieve high r values. During analysis, we will take into 
account the variance of the estimated r's in assessing the pre- 
cision of our disease incidence estimates. Finally, some might 
argue that our case definition of MSD could bias our patho- 
gen-specific disease estimates by overestimating the impor- 
tance of agents that cause dysentery. Our decision to include 
dysentery is supported by published observations indicating 
that children with dysentery have an increased risk for per- 
sistent diarrhea, growth faltering, and death [14, 38, 39]. 
These concerns can be addressed in the analysis because we 



know the proportion of all children seeking care at each 
SHC with MSD that have dysentery, so adjustments can be 
made as necessary if children with and without dysentery are 
not equally sampled. We also know the prevalence of dysen- 
tery among children in the DSS population based on serial 
HUAS-lite rounds and can adjust our population-based esti- 
mates accordingly. 

An important contribution of GEMS is the single follow-up 
visit to the homes of both cases and controls approximately 
60 days after enrollment, which will allow us to elucidate the 
outcome of children during the vulnerable period that follows 
acute MSD. The few cross-sectional health center-based 
studies in developing countries that have contacted children 
after discharge suggest that most sequelae are missed if sur- 
veillance is limited to the hospital stay [40, 41]. A caveat is 
that we will be unable to prospectively define interim events 
that might influence the outcomes, including recurring epi- 
sodes of diarrhea. Important information will be gleaned 
nonetheless by evaluating the same outcomes in case and 
control children and determining the relative risk of adverse 
clinical outcomes during the 50-90 days following an episode 
of MSD. The lack of interim contact with participants will 
also impact the quality of data generated by the memory aid 
regarding the occurrence of diarrhea during the 14 days after 
enrollment. 

In sum, we have described the design and methods of 
GEMS and our efforts to achieve scientific rigor while main- 
taining simplicity and standardization. We presented a candid 
portrait of the considerations that were entertained in develop- 
ing the study design, the challenges encountered, and solu- 
tions developed along with the potential strengths and 
limitations of the methods. This level of detail is intended to 
provide the scientific and public health communities with 
high-quality data that can be used to update and strengthen 
diarrheal disease burden models and to guide strategic plan- 
ning and resource allocation for the future. 
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